Variational wave functions, ground state and their overlap 
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An intrinsic measure of the quality of a variational wave function is given by its overlap with the 
ground state of the system. We derive a general formula to compute this overlap when quantum 
dynamics in imaginary time is accessible. The overlap is simply related to the area under the 
E(t) curve, i.e. the energy as a function of imaginary time. This has important applications to, 
for example, quantum Monte-Carlo algorithms where the overlap becomes as a simple byproduct 
of routine simulations. As a result, we find that the practical definition of a good variational 
wave function for quantum Monte-Carlo simulations, i.e. fast convergence to the ground state, is 
equivalent to a good overlap with the actual ground state of the system. 

PACS numbers: 



Variational wave functions (VWF) are very valuable 
tools to study interacting quantum systems. Examples 
are numerous and can be found in many fields of physics, 
like Helium 4 high Tc superconductors Q or the 
fractional quantum Hall effect Given a variational 
wave function tyy, it is not difficult to sample |\fV| 2 
from which one obtains the expectation value of many 
physical observables. It remains difficult however to de- 
termine to which degree is a good approximation of 
the true ground state of the system. A first answer 
to this question lies in the variational theorem itself: as 
the variational energy is always higher than the ground 
state energy, one attempts to get the VWF with the low- 
est energy. The drawback of this criterion is that VWFs 
with similar variational energies can convey very differ- 
ent physics as the energy is very sensitive to the short 
range part of the VWF, i.e. when two particles are close 
to each other, but rather weakly to the long range part. 
This is unfortunate as other physical observables may 
depend crucially on the VWF. Another (standard) pos- 
sibility is to pick the VWF that has the lowest variance of 
its energy. The variance criterion has some advantages 
over the energy Q as it is a more absolute criteria: a 
zero variance means that the VWF is an eigenstate of 
the system (but not necessarily the ground state). 

In this letter, we concentrate on a more intrinsic crite- 
rion, namely maximizing the overlap Q: 
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of with the actual ground state 'J'o of the system. A 
direct calculation of Q would require the complete knowl- 
edge of the ground state \&o, which is extremely com- 
putationally demanding. The main result of this letter, 
namely Eqs. ([3]) and (j4|), is that can be related to the 
energy, upon projection of the initial VWF in imaginary 
time. Hence, f2 can be simply obtained as the byprod- 



uct of quantum Monte-Carlo simulations. In this letter, 
we focus on this particular method to determine fl We 
would like to emphasize, however, that our main result 
together with inequalities ([6]), (O and (fTTj) are universal 
and can be applied to other methods. 

The development of zero temperature quantum Monte- 
Carlo (QMC) techniques (Diffusive or Green function 
Monte-Carlo) relics on the availability of good VWFs. 
Although those techniques allow one to access ground 
state properties, VWFs play a crucial role for two rea- 
sons. Firstly, QMC uses a VWF to properly sample the 
Hilbert space through "importance sampling" . An ho- 
mogeneous sampling of Hilbert space would mean spend- 
ing a very large amount of time sampling regions of the 
Hilbert space that have almost no contribution to \I/o- 
Secondly, even though QMC simulations can give inter- 
esting information on the system they do not necessarily 
explain the physical mechanisms involved. Valuable in- 
sight can often be obtained just by looking at how the 
VWF is constructed. For instance the short and long 
range behavior of a Jastrow type VWF, or more dra- 
matically the analytical structure of the Laughlin wave 
function in the fractional quantum Hall effect conveys in 
itself useful information. With QMC comes an empirical 
criterion for what is a good VWF: it should allow the 
simulation to converge from vpy to as fast as possi- 
ble. We shall see that this criterion actually coincides 
with maximizing the overlap f2 of with the actual 
ground state ^o- 

The idea to maximize the overlap as a variational 
criterion was put forward twenty years ago 0, @, 0]. 
It was shown that for a certain class of VWF, merely 
of the Jastrow type and its extensions, maximizing f2 
amounts to choosing the Jastrow function that repro- 
duces exactly the (mixed estimator of the) static struc- 
ture function. Hence the practical criterion was to op- 
timize the static structure function obtained from varia- 
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FIG. 1: (color online) Typical curve for the energy E(t) as a 
function of the imaginary time r. The thick line is a typical 
trace (with high precision) while the dashed line corresponds 
to the asymptotic value Eo . The logarithm of the overlap Q is 
simply given by the shaded area between the two curves (see 
text). The data have been obtained for the model of dipolar 
bosons, defined Eq.(|8}, with very high precision. 



tional Monte-Carlo by comparison with that coming out 
of QMC simulations. Here we choose a different route 
and show that il can be computed directly as a simple 
byproduct of a QMC run. In QMC techniques one starts 
with an initial wave-function and then integrates in a 
stochastic way the imaginary time Schrodinger equation 
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d T ^ = —H^, the formal solution being \P(t) 
For a large r, \&(t) actually converges toward \&o- In 
practical simulations, one usually computes the energy 



E(t) = 
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until E(t) has converged to its asymptotic value, the 
exact ground state energy Eq. An example of a typical 
E(t) curve is shown in Fig. [T] for the system discussed at 
the end of this letter. By introducing re as 



n = 



(3) 



the principal result of this letter is that re is simply given 
by the shaded area in Fig. [TJ Or more precisely, 



k= dr [E(t) - E Q ] 
Jo 
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It is therefore straightforward to obtain re from a QMC 
simulation. 

Eq.Q calls for a few comments, (i) as mentioned 
above, Eq.([l|) combines a theoretical criterion, maximiz- 
ing the overlap between \ty and ^o, and a practical cri- 
terion that is fast convergence to Eq . Conversely, a wave- 
function that has a low variational energy but converges 
very slowly toward Eq has a poor overlap with the actual 
ground state, (ii) re is not a substitute for the variational 
energy (or variance) as it requires a full QMC simula- 
tion, (iii) In contrast with energy and energy variance, 
fl is dimensionless and hence has an absolute meaning. 
For example £1 — 0.97 means that the VWF captures 



97% of the ground state, (iv) In some instances, one is 
interested in the thermodynamic N — * oo limit, where N 
is the number of particles in the system. It is easy to be 
convinced that the generic behavior of f2 is an exponen- 
tial decrease with N. This can be seen for instance in 
a non-interacting Bose-Einstein condensate, where any 
error in the one particle wave-function appears to the 
power N in the many-body wave function. More gen- 
erally the energy is usually an extensive quantity and 
hence re scales linearly with N for large N. In that case, 
the correct measure of the accuracy of a VWF is k/N 
so that ft = (0.99) w for example means that the VWF 
captures "per particle" 99% of the ground state. k/N 
usually shows weak finite size effect upon increasing N. 
(v) In practice, we have found that the accuracy of re is 
similar to that obtained for other physical quantities like 
density or density-density correlations but slightly less 
precise than that achieved for E (Relative precisions of 
10~ 4 or better are routinely obtained for the latter). 

Proof of Eq. 01). The proof is straightforward. 
We introduce the pseudo-partition function Z{r) = 
(*y|*(r)} = (^ v \e^ rH \^ v ), which, in analogy to the 
finite temperature partition function is related to the en- 
ergy through E(t) = — 9 r logZ(r). Defining ^r as the 
ground state normalized to unity, \&(t) converges towards 
*S?(t) — ► y/ Z(2r)^ for large r. Using the definition of 
fl, and Z(t) one obtains 
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Further, from E(t) = — d T \og Z(t) one finds 
Iog(Z(r)/Z(0)) = -J T E(r)dr and log(Z(2r)/Z(r)) = 
— J t 2t E{r)dr. In the latter, for r large enough, E{t) ~ 
E such that Z(2t)/Z(t) - exp(-£ T)- Collecting 
terms together in Eq.flSJ), we arrive at Eq.(@J. 

Link with mixed estimators. One drawback of QMC 
calculations is that when the quantum average of an 
observable A is measured, the mixed estimate Amx — 
(^v\M^o) / (^vl^o) naturally emerges. For some ob- 
servables it is possible to actually calculate the cor- 
rect quantity A Q = (* |^|*o)/{*o|*o) using, for in- 
stance, forward walking techniques 0. However this 
concerns mainly local quantities and does not apply 
to non-local ones. For the latter, one has to rely on 
the extrapolation formula, Aq m 2Amx — Ay where 
A v = (^ V \A\^ V )/(^ V \^ V ). This formula [9] is only 
valid when \P is close to Vfy, otherwise it is uncontrolled. 
If A is definite positive, it takes the form A = d^d and the 
overlap allows one to obtain the following lower bound for 
A , 



A > 
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A particularly interesting example is the condensate frac- 
tion of a Bose condensate where the operator d' cre- 
ates a particle in the k = state. Unfortunately, this 
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lower bound is only useful for small systems like atoms 
or molecules, or for extremely good VWFs, since the 
exponentially decreasing nature of the overlap quickly 
makes it meaningless. To prove Eq.©, one simply 
writes Schwartz inequality, \(C\B)\ 2 < (C\C)(B\B) with 
\C) = d|* > and \B) = d\^ v ) 

Link with the energy gap. Another application of the 
calculation of the overlap is that it gives access to an 
upper bound value for the gap of the system, i.e. to 
information on the excitation spectrum. Indeed, it is 
straightforward to show that the difference A between 
the first excited state and Eq obeys: [Tol| 
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Again, such an upper bound value is usually useless in 
the thermodynamic limit (N —* oo) where there usually 
is a continuum of excitations. It can be used however 
for molecular or atomic systems. In this case, one should 
look for a wave-function close to the first excited state. 
Such a VWF has a rather low energy but also a low 
overlap with the ground state. In practice the VWF, 
being close to an eigenstate, has a low variance, and as 
the variance is —dE/dr\ T= o, the E(t) curve converges 
slowly to the ground state energy, hence resulting in a 
small overlap. The quality of this upper bound value 
depends on the projection of the VWF on the excited 
states other than the first one and the inequality becomes 
an equality when the VWF has projections only on the 
ground state and first excited state. 

Application. To illustrate the utility of the above dis- 
cussion, we now turn to a specific example where the 
calculation of the overlap can be particularly useful. The 
system discussed below is close to a first order liquid- 
solid transition. On one hand the chosen VWF is close 
to the liquid state so that optimizing the variance or the 
energy leads closer to the liquid state. On the other hand 
the true ground state is the crystal as indicated by the 
calculation of the overlap. More precisely, we consider a 
system of N bosons in two dimensions with a repulsive 
dipolar interaction. This system is subject to current 
research as it is a candidate for a realizing a crystal in 
ultracold atom experiments llj, |l2j . A detailed study of 
the model will be presented elsewhere , and we focus 
here on the relevance of fi. The scaled Hamiltonian takes 
the form, 
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where r$ controls the relative strength of the dipolar in- 
teraction over the kinetic one. This model shows a first 
order transition at r$ = r s ~ 27: For r$ < r s the sys- 
tem is in a Bose-Einstein phase while for r$ > r s the 
system crystallizes into a triangular lattice. Note that 
this crystal-Bose Einstein transition has been discussed 




FIG. 2: Upper panel: parameter k/N measuring the overlap 
between the guiding function and the actual ground state of 
the system as a function of the symmetry breaking param- 
eter a. The arrow indicates that the point at k(ol = 0) is 
lower than the correct value, a small o^O being needed for 
the simulation to fully converge to the ground state. Middle 
panel: variational energy Ev as a function of a. Lower panel: 
square root of the quantum variance a v of the VWF as a 
function of the symmetry breaking parameter a. All data are 
taken for 32 bosons in a 32 x 56 grid at rs = 28.6. 



recently in Refs. [lll.ll 
form: 
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where the Jastrow part includes two-body correlations, 
$2(?*) = cxp (— 2y / ^e _r / j4 ) . The one-body part allows 
to break translational symmetry and interpolates from 
a condensate-like VWF to a crystal-like VWF. Noting 
Ay, the distance between lattice sites of the crystal along 
the y axis, we define the vector qi = (0, 2ir/ Ay) in the 
reciprocal lattice. Vectors q 2 /3 are obtained by rotating 
qi by an angle of 27r/3 and — 27r/3. We choose a one-body 
trial function 



$i(r) = J] (l + acos(qi-r)) 



(10) 



i=l,2,3 



whose maxima reproduce the triangular lattice expected 
for the crystal. This function is well-suited to describe 
quantum melting since it interpolates between a flat 
liquid(BEC)-type pattern for a = to a triangular crys- 
tal form for a/0. Setting rg = 28.6, i.e. slightly above 
the crystalline transition, we investigate our VWF as a 
function of the translational symmetry breaking parame- 
ter a. The results are presented in Fig . [2 1 The details of 
our algorithm can be found in ref 13j, 1 1 41 ] . In particular 
we used the Green function Monte-Carlo technique on a 
spatial grid with a filling factor v = 1/56 particles per 
site. 

The system is clearly in a crystal state, as demon- 
strated by computing the static structure factor, and 
hence a good variational ansatz is expected for a / 0. 
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Fig. [2] shows however that both the variational energy 
and variance indicate a minimum for a = 0. On the 
other hand k decreases with a indicating that the phase 
with a ^ is the correct one. This is an extreme case 
where the traditional criterion on the energy and variance 
actually gives a false answer even qualitatively while the 
overlap indicates the correct answer. 

Conclusion. It is interesting to note that both the 
standard criteria used to characterize a VWF (variational 
energy and variance), as well as the overlap discussed in 
the present letter, are all different aspects of the energy- 
imaginary time E(t) curve: the variational energy Ey = 
E(t = 0), the variational variance a v = — dE / dr\ T -Q 
and the overlap is the integral of E(t). Hence the differ- 
ent criteria give informations on different characteristics 
of E(t). While no general statement can be made, in 
many instances the VWFs used are a fair description of 
the ground state. In these cases E(t) looks typically like 
the curve shown in Fig[T]and, in particular, has a positive 
curvature. Assuming a positive curvature, we find that 
the various criteria are related to each other as 



n <cxp[-(E v -E ) 2 /(2al)] 



(11) 



obtained using the fact that E(t) lies above its tangent at 
t = 0. Although the above inequality is not completely 
general, it gives a rough estimate of the overlap in many 
practical cases. One can note that strictly speaking, the 
above estimate decreases when the variance decreases. It 
is therefore imperative that the variance and variational 
energy are optimized simultaneously. 

To conclude this letter, we have shown that from the 
data given by usual QMC calculations, it is possible to 



extract relevant information on the quality of the varia- 
tional wave-function used. We stress that our main re- 
sult, Eq. HJ, applies generally to any projection tech- 
nique in imaginary time and not only to QMC. 
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